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Abstract. The purpose of this paper is to provide a sharp analysis on the as- 
ymptotic behavior of the Durbin- Watson statistic. We focus our attention on the 
first-order autoregressive process where the driven noise is also given by a first- 
order autoregressive process. We establish the almost sure convergence and the 
asymptotic normality for both the least squares estimator of the unknown param- 
eter of the autoregressive process as well as for the serial correlation estimator 
associated to the driven noise. In addition, the almost sure rates of convergence 
of our estimates are also provided. It allows us to establish the almost sure con- 
vergence and the asymptotic normality for the Durbin- Watson statistic. Finally, 
we propose a new bilateral statistical test for residual autocorrelation. 



1. INTRODUCTION 

The Durbin- Watson statistic is very well-known in Econometry and Statistics. It 
was introduced by the pioneer works of Durbin and Watson [6] , [7] , [8] , in order to 
test the serial independence of the driven noise of a linear regression model. The 
statistical test based on the Durbin- Watson statistic works pretty well for linear 
regression models, and its power was investigated by Tillman [20] . However, as it 
was observed by Malinvaud [H] and Nerlove and Wallis [15], its widespread use 
in inappropriate situations may lead to inadequate conclusions. More precisely, for 
linear regression models containing lagged dependent random variables, the Durbin- 
Watson statistic may be asymptotically biased. In order to prevent this misuse, 
Durbin [I] proposed alternative tests based on the redesign of the original one. 
Then, he explained how to use them in the particular case of the first-order au- 
toregressive process previously investigated in [2] and [32] . Maddala and Rao [T3] 
and Park [TH] showed by simulations that alternative tests significantly outperform 
the inappropriate one even on small-sized samples. Inder [10], [H] and Durbin [5] 
went even deeper in the approximation of the critical values and distributions of the 
alternative tests under the null hypothesis. Afterwards, additional improvements 
were brought by King and Wu [12] and more recently, Stocker [17] gave substantial 
contributions to the study of the asymptotic bias in the Durbin- Watson statistic 
resulting from the presence of lagged dependent random variables. 
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Our purpose is to investigate several open questions left unanswered during four 
decades on the Durbin- Watson statistic jl], [3], [T5]. We shall focus our attention 
on the first-order autoregressive process given, for all n > 1, by 



'IX 



X n — 6X n _\ + e 



n 



where the unknown parameters \9\ < 1, \p\ < 1. Via an extensive use of the theory of 
martingales [3] , [9] , we shall provide a sharp and rigorous analysis on the asymptotic 
behavior of the least squares estimators of 9 and p. The previous results of conver- 
gence were only established in probability [H] , [15] . We shall prove the almost sure 
convergence as well as the asymptotic normality of the least squares estimators of 9 
and p. We will deduce the almost sure convergence and the asymptotic normality 
for the Durbin- Watson statistic. Therefore, we shall be in the position to propose 
a new bilateral test for residual autocorrelation under the null hypothesis as well as 
under the alternative hypothesis. 



The paper is organized as follows. Section 2 is devoted to the estimation of the 
autoregressive parameter. We establish the almost sure convergence of the least 
squares estimator 9 n to the limiting value 

(1.2) 9* 9 + P 



l + 9p 



One can observe that 9* = 9 if and only if p = 0. The asymptotic normality of 9 n as 
well as the quadratic strong law and the law of iterated logarithm are also provided. 
Section 3 deals with the estimation of the serial correlation parameter. We prove 
the almost sure convergence of the least squares estimator p n to 



(1.3) p* = 9p9* = "\ K " +9 P) . 

As before, the asymptotic normality of p n , the quadratic strong law and the law 
of iterated logarithm are also provided. It allows us to establish in Section 4 the 
almost sure convergence of the Durbin- Watson statistic D n to 

(1.4) D* = 2(l-p*) 



together with its asymptotic normality. Our sharp analysis on the asymptotic be- 
havior of D n is true whatever the values of the parameters 9 and p inside the interval 
]— 1, 1[. Consequently, we are able in Section 4 to propose a new bilateral statistical 
test for residual autocorrelation. A short conclusion is given in Section 5. All the 
technical proofs of Sections 2, 3, and 4 are postponed in Appendices A, B, and C, 
respectively. 
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2. ON THE AUTOREGRESSIVE PARAMETER 

Consider the first-order autoregressive process given by ( 11. ip where the initial 
values X and Eq may be arbitrarily chosen. In all the sequel, we assume that (V^) 
is a sequence of square-integrable, independent and identically distributed random 
variables with zero mean and variance a 2 > 0. In order to estimate the unknown 
parameter 9, it is natural to make use of the least squares estimator 9 n which 
minimizes 



An(0) = ^(X k -6X k . 



i) 2 - 



k=l 



Consequently, we obviously have for all n > 1, 



(2.1) 9 r , 



Z^k=i ^k-i 



Our first result concerns the almost sure convergence of 9 n to the limiting value 
9* given by (II. 2p . One can observe that the convergence in probability of 9 n to 9* 
was already proven in [13] , [15] . We improve this previous result by establishing the 
almost sure convergence of 9 n to 9* . 

Theorem 2.1. We have the almost sure convergence 

(2.2) lim 9 n = 9* a.s. 

n— >oo 

Our second result deals with the asymptotic normality of 9 n where we denote 



(2.3) 



■2 



[l-9 2 )(l-9p)(l-p 
(1 + 9pf 



Theorem 2.2. Assume that (V n ) has a finite moment of order 4. Then, we have 
the asymptotic normality 

(2.4) ^(e n -9*) -^M(0,a 2 e ). 



Remark 2.1. In the well-known case where the residuals are not correlated, which 
means that p = 0, we clearly have 9* = 9, a 2 = 1 — 9 2 and we find again the 
asymptotic normality 

C 



y/n(e n -ij -^AT(0,l-9 2 ). 



After establishing the almost sure convergence of the estimator 9 n and its asymp- 
totic normality, we focus our attention on the almost sure rates of convergence. 

Theorem 2.3. Assume that (V n ) has a finite moment of order 4. Then, we have 
the quadratic strong law 



1 " 

(2.5) lim V (0 k 

to k=l 



2 

9* ) = (Jfl a.s. 
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where aj is given by (12. 3p . In addition, we also have the law of iterated logarithm 

\ 1/2 / \ 1/2 



limsup — — (0 n -9*) = -liminf — — [0 n -6* 

n->oc \2l0gl0gn/ V / n->oo ^loglogTT. 

(2.6) = oq a.s. 

Consequently, 



(27 > limsu p(2i^K«»-"*r=-j 



a.s. 



Proof. The proofs are given in Appendix A. □ 
Remark 2.2. It clearly follows from (12.71) that 

(2.8) (e u -e-) 2 = o( 1 ^^) a,. 



n 

This almost sure rate of convergence will be useful in all the sequel. 

3. ON THE SERIAL CORRELATION PARAMETER 

This section is devoted to the estimation of the serial correlation parameter p. 
First of all, it is necessary to evaluate, at step n, the least squares residuals given, 
for all 1 < k < n, by 

(3.1) Ek = Xk — 9 n Xk-i- 

The initial value e~o may be arbitrarily chosen and we take e~o — Xq. Then, a natural 
way to estimate p is to make use of the least squares estimator 

En »-v 
fc=l e k£k-l 
Pn — sr^n ^2 

Z^fc=l £ k-l 

The asymptotic behavior of 9 n and p n are quite similar. However, one can realize 
that the results of this section are much more tricky to establish than those of the 
previous one. We first state the almost sure convergence of p„ to p*. 

Theorem 3.1. We have the almost sure convergence 

(3.3) lim p n = p* a.s. 

Our next result deals with the joint asymptotic normality of 9 n and p n . Denote 

(3.4) el = ^^{{0 + P) 2 (l + 9 P f + {9p)\l - 9*){l - p 2 )). 

In addition, let V be the semi-definite positive covariance matrix given by 

(3.5) r=f/% Off' 



ON THE ASYMPTOTIC BEHAVIOR OF THE DURBIN- WATSON STATISTIC 5 

Theorem 3.2. Assume that (V n ) has a finite moment of order 4. Then, we have 
the joint asymptotic normality 

(3.6) yfr( i"2 9 l) ^>A/-(o,r). 

V Pn P J 

In particular, 

(3.7) v^(/5»-/>*) ^AT(0,^). 

Remark 3.1. The covariance matrix F is invertible if and only if 6 ^ — p since one 
can see by a straightforward calculation that 

detrn - oW + pW-op) 
det[) ~ (i + p 2 ) 

Moreover, in the particular case where 9 = — p, 

rfO n Atf(o,±^j and ^ip n -^NU ^^P )- 

Finally, if the residuals are not correlated which means that p = 0, 

C 



np n -^Af{0,9 2 ). 

The almost sure rates of convergence for p n circ £is follows. 

Theorem 3.3. Assume that (V n ) has a finite moment of order 4. Then, we have 
the quadratic strong law 



1 n 

(3.8) lim- J^fe-P* 

n->oo log n z — ' V 
& k=i 



2 

= a 2 p a.s. 



where a 2 is given by (13. 4p . In addition, we also have the law of iterated logarithm 

\ 1/2 / \ 1/2 

n \ ( ^ a .. „ / n 



lim sup — — : Pn-P* = -liminf — — [p n - p* 

n^oo \21oglogn / V / n^co ^2 log log n 

(3.9) = cr p a.s. 

Consequently, 



n 



2 

2 



(3.10) lim sup — — ) [p n - p* =a a.s. 

Proof. The proofs are given in Appendix B. □ 
Remark 3.2. We obviously deduce from (13.101) that 

(3.11) ( ? „- p .) 2 =0 (!^i) a., 
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The estimators 9 n and p n are self-normalized. Consequently, the asymptotic vari- 
ances <Jq and a 2 do not depend on the variance a 2 associated to the driven noise 
(V n ). We now focus our attention on the estimation of a 2 . The estimator p n allows 
us to evaluate, at step n, the least squares residuals given, for all 1 < k < n, by 

Vk = £/t — Pn £ k-1- 
Then, we propose to make use of 



n < * 



n 

k=l 



We have the almost sure convergence 



a 2 ((l + 6p) 2 -(6p) 2 (9 + p) 2 ) 



(3 - 12) lim ^ = FTO a - s - 



n— Kx) 



The proof is left to the reader as it follows essentially the same lines as that of (13. 3ft . 

4. ON THE DURBIN- WATSON STATISTIC 

We shall now investigate the asymptotic behavior of the Durbin- Watson statistic 
[S], [I], given, for all n > 1, by 



(4.1) A 



Z^fc=O fc A 



One can observe that -D n and p n are asymptotically linked together by an affine 
transformation. Consequently, the results of the previous section allow us to estab- 
lish the asymptotic behavior of D n . We start with the almost sure convergence of 
D n to D*. 

Theorem 4.1. We have the almost sure convergence 

(4.2) lim D n = D* a.s. 

Our next result deals with the asymptotic normality of D n . It will be the keystone 
of a new bilateral statistical test deciding in particular, for a given significance level, 
whether residuals are autocorrelated or not. Denote a 2 D = Aa 2 where the variance 
a 2 is given by (13 .4p . 

Theorem 4.2. Assume that (V n ) has a finite moment of order 4. Then, we have 
the asymptotic normality 

(4.3) V£ -^M(0,a 2 D ). 
Remark 4.1. We immediately deduce from ( 14. 3 p that 



(4.4) 4 



a 



D 



;1 



where \ 2 has a Chi-square distribution with one degree of freedom. 
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Before providing our statistical test, we focus our attention on the almost sure 
rates of convergence for D n which are based on the asymptotic linear relation be- 
tween D n and jo n . 

Theorem 4.3. Assume that (V n ) has a finite moment of order 4. Then, we have 
the quadratic strong law 



(4.5) lim -L V] (3 k - D 

n-Hx> log n z — ' V 



a D a.s. 



log \ . 
to fe=i 

In addition, we also have the law of iterated logarithm 

limsupf— V (D n -Lr) = -liminff— V 

„^oo \2 log log nj V J n-^co \2 log log n 

(4.6) = od a.s. 

Consequently, 



n 



2 



(4.7) lim sup h— j \ [D n — D* ) = a D a.s. 

We are now in the position to propose our new bilateral statistical test built on 
the Durbin- Watson statistic D n . First of all, we shall not investigate the trivial 
case 6 = since our statistical test procedure is of interest only for autoregressive 
processes. In addition, we shall note the existence of a critical case as introduced 
in Remark 13.11 Indeed, if 9 = —p, the covariance matrix T given by (I3.5P is not 
invertible and the distribution of the statistic associated to the test we plan to 
establish will be degenerate. For this reason, we suggest a preliminary test for the 
hypothesis u 9 = — p" , allowing us to switch from one test to another if necessary. 
More precisely, we first wish to test 

U : u 8 = -p n against Hi : u 9^-p". 

Under the null hypothesis Hq, it is easy to see that D* = 2. According to Remark 
13.11 we have 

n(l-» 2 ) /K „\ 2 C 2 



< 48 > W(TT¥){ D "- 2 ) 

where x 2 has a Chi-square distribution with one degree of freedom. Moreover, the 
model can be rewritten under Ho, for all n > 2, as 

(4.9) X n = 9 2 X n _ 2 + V n . 

Then, we propose to make use of the standard least squares estimator ^ of 9 2 

(4.10) di = E ^ Xk x ~ 2 2Xk . 

Under Ho, we have the almost sure convergence of d 2 to 9 2 . In addition, we obviously 
have D* ^ 2 under H\. These results under the null and the alternative hypothesis 
lead to Theorem 14.41 whose proof immediately follows from ( 14.81 ) . 
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Theorem 4.4. Assume that (V n ) has a finite moment of order 4, 9 ^ and p ^ 0. 

Then, under the null hypothesis Ho : 11 9 = — p" , 

"(l-*2) o\ 2 £ ..a 



(4.11) — ^ ^ D n -2 

w(i+^)V ; 

where x 2 has a Chi-square distribution with one degree of freedom. In addition, 
under the alternative hypothesis Hi : u 9 ^ — p", 

n (l — si 2 ) f ^ N 2 

(4.12) lim -H^[D n -2) = +oo a.s. 

rwoc 4(^)2(1 + 02) V J 

For a significance level a where < a < 1, the acceptance and rejection regions 
are given by A = [0, z a ] and 1Z =]z a , +oo[ where z a stands for the (1 — a)-quantile 
of the Chi-square distribution with one degree of freedom. The null hypothesis Ho 
will be accepted if the empirical value 

' D„ - 2 ) <«., 



and rejected otherwise. Assume now that we accept Ho, which means that we admit 
de facto the hypothesis u 9 = — p". For a given value p such that |p | < 1, we wish 
to test whether or not the serial correlation parameter is equal to po, setting 

Ho : "p = Po" against %i : "p^p ". 

One shall proceed once again to the test described by Theorem 14.41 taking p\ in 
lieu of i?^, insofar as one can easily agree that our test statistic satisfies the same 
properties, under Ho as under Hi, by virtue of Remark 13. II This alternative solution 
is necessary to avoid the degenerate situation implied by the critical case 9 = —p. 
Let us now focus on the more widespread case where the preliminary test leads to 
a rejection of Ho, admitting u 9 ^ — p". For that purpose, denote 9 n = 9 n + p n — p 
and D n — 2(1 — p re ) where 



n\@n + Po) 

(4.13) p n = 



One can observe that our statistical test procedure works whatever the value of the 
autoregressive parameter 9 inside the interval ]— 1, 1[ with 9 ^ —p. Moreover, it 
follows from (12.21) and (13. 3p that under the null hypothesis Ho, 

lim 9 n = 9 + po — po = 9 a.s. 

n— >oo 

To construct our statistical test, we need to introduce more notations. Denote 

a n = ~P0 (On + On) = ~P0 (2^n + Pn ~ Po) , 
b n = 1 — Po@n, 
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and let w n be the vector of IR 2 given by w' n = (a n , b n ). In addition, let 
(4.14) f n 



a n PoVnOln 

Pod 



where a n and /3 n are defined as 

(i-0*)(i-M.)(i-p§) 



a, 



[1 + PoOn] 



3 



% = Po ~ n l ((e n + p ) 2 (i + Poe n ) 2 + ( Po e n ) 2 (i - %) (i - P D) . 

(1 + P0^n) 3 

Furthermore, denote 

4 - 

(4.15) f n 2 = ^r— w' n Y n w n . 

(1 + po#nr 

Theorem 4.5. Assume that (V n ) has a finite moment of order 4, 9 ^ p and 6 ^ —p. 

Then, under the null hypothesis Ho : "p = p " > 

(4.16) £-(D n -D n ) 2 A X 



2 



where \ 2 has a Chi-square distribution with one degree of freedom. In addition, 
under the alternative hypothesis Hi : "p 7^ po" , 



n 



(4.17) lim — lD n — D n ) =+00 a.s. 



v 9 

n— >oo T 
n 

One can observe by a symmetry argument on the role played by 9 and p, that the 
assumption 9 = p is not restrictive since the latter can be seen as another way of 
expressing Theorem 14.51 From a practical point of view, for a significance level a 
where < a < 1, the acceptance and rejection regions are given by A = [0, z a ] and 
1Z —]z a , +oo[ where z a stands for the (1 — a)-quantile of the Chi-square distribution 
with one degree of freedom. The null hypothesis Ho will be accepted if the empirical 
value 

^2 \ D n - D n J < z a , 
and rejected otherwise. Moreover, if one wishes to test 

Ho : "p = 0" against Hi : "p^O", 

our statistical test procedure is very simple. As a matter of fact, we are in the 
particular case Po = which means that D n — 2, a n — and b n — 1. We can also 
replace 9 n by 9 n so r n 2 reduces to = 4# 2 . 

Theorem 4.6. Assume that (V n ) has a finite moment of order A, 9^0 and 9 7^ —p. 
Then, under the null hypothesis Ho '■ "p = 0" , 

(4.18) JL( S „- 2 ) 2 ^ 
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where x 2 has a Chi-square distribution with one degree of freedom. In addition, 
under the alternative hypothesis %i : "p 7^ 0" , 

(4.19) lim— (D n -2) = +00 a.s. 

rwoo Af)2 \ J 
n 

Proof. The proofs are given in Appendix C. □ 



5. CONCLUSION 

Via an extensive use of the theory of martingales, we have provided a sharp 
analysis on the asymptotic behavior of the least squares estimators 9 n and p„ which 
has allowed us to deduce the asymptotic behavior of the Durbin- Watson statistic D n 
for the first-order autoregressive process. More precisely, we have established the 
almost sure convergence and the asymptotic normality for all three estimators 9 n , 
f) n and D n . In addition, we have proposed a new bilateral statistical procedure for 
testing serial correlation, built on D n . All these results give a new light on the well- 
known test of Durbin- Watson in a context of lagged dependent random variables. 
From a practical standpoint and for a matter of completeness, we may wonder about 
the estimation of the true values of the parameters 9 and p. As soon as 9 ^ —p, 
we can estimate 9 and p by solving the nonlinear system of two equations given, for 
a n = 9 n + p n and b n = p n /9 n , by 

lim a n = 9 + p 

n—>oo 

^ a.s. 
lim b n 



n—>oo 



One can easily find two couples of solutions, symmetrically linked together. For 
example, assuming 9 < p, we propose to make use of 



a%-4b n _ a n + A/a2-46 n 
9 n = 2 and Pn = 2 ' 

merely inverting the values of 9 n and p n whether, for some statistical argument, we 
would rather choose 9 > p. By the same token, it is also possible to estimate the 
true variances a 2 , a 2 , a 2 and a 2 D . For example, via convergence f)3.12p . we propose 
to estimate a 2 by 

l-6„)(i+^ 3 




(?„ = I I CT„. 

r l + b n ) 2 -(a n b n ) 2 



n ■ 



This work lifts the veil on a set of questions for long left unanswered about the 
pioneer works of Durbin and Watson [6], [7], [8], [H], [15]. As an improvement, 
it would be useful to extend our analysis to p-order autoregressive processes. In 
addition, it would be very interesting to investigate the asymptotic behavior of the 
Durbin- Watson statistic D n in the explosive case where \9\ > 1 or \p\ > 1. 
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A.l. Proof of Theorem EIH 

We start with some useful technical lemmas we shall make repeatedly use of. The 
proof of the first one may be found in [3] page 24. 

Lemma A.l. Assume that (V n ) is a sequence of independent and identically dis- 
tributed random variables such that, for some a > 1, E,[\Vi\ a ] is finite. Then, 



a.s. 



1 " 

(A.l) lim -Vl^l^Efl^H 

n— >oo fl ' J 
k=l 

and 

(A.2) sup | Vfc| = o(n l/a ) a.s. 

l<fc<n 

Lemma A.2. Assume that (V n ) is a sequence of independent and identically dis- 
tributed random variables such that, for some a > 1, E[|Vi| a ] is finite. If {X n ) 
satisfies (II. ip with \9\ < 1, \p\ < 1, then 

n 

(A.3) ^\X k \ a = 0(n) a.s. 

fc=i 

and 

(A.4) sup \X k \ = o(n 1/a ) a.s. 

l<fc<n 

Remark A.l. In the particular case a = 2, we obtain that 

s ^^Xl = 0{n) and sup X\ = o(n) a.s. 

, -, Kk<n 
k=l — — 

Proof. It follows from (If .ip that for all n > 1, 

n 

(A.5) \X n \ < \9\ n \X \+Y l \6\ n - k \e k \. 

k=l 

Consequently, as |#| < 1, we obtain that 
(A.6) sup \X k \ < 1 (|X | + sup \e k 

l<k<n t — \t)\ \ l<k<n 

By the same token, as \p\ < 1, we also deduce from ( 11.11) that 
(A.7) sup \e k \ < 1 (Vol + sup \V k 



l<k<n 1 — \P\ v l<fc<n 

Hence, (IA. 2[) together with (IA.6[) and (IA.7[) obviously imply 



sup l-Xfc] = o{n l l a ) a.s. 

Kk<n 
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Furthermore, let b be the conjugate exponent of a, 

1 1 



a b 



1. 



It follows from (1A.5I) and Holder's inequality that for all n > 1, 

/ n \ 1 / a /n \ 1 / b 

\x n \ < \e\ n \x \ a + \o\ n - k \ek\ a Yl i^r fc 



which implies that 



\ a/b 

k 



,k=0 



,k=0 

\ a / b 



< 



k=0 

< (i-\e\ 

Consequently, 

n 
k=l 



-a/b 



\9\ n \X \ a + J2\9\ n - h \e k \ a 

k=0 / 

\9\ n \X Q \ a + J2\9r- k \e k A , 
k=l J 

\9\ n \X \ a + J2\9\ n - k \e k A . 



k=l 



< (i-\e\ 



-a/b 



-a/b 



n k 



J2\9\ k \x \«+j2J2\ e \ k ~ £ \ £ t\ a 

k=l k=l £=1 

n n n 



k-e 



k=l 
n 



=1 k=l 



(A.8) 



< (l ~ Idly* \^Xo\ a + ^\ek\ a j. 



Via the same lines, we also obtain that 

n 

(a.9) Ei e *i tt ^( 1 -^)~ u (i £ oi a+ Eiw)- 



k=l 



k=l 



Finally, (1 A. 1 1) together with (|A.8[) and (IA.9I) lead to (IA.3I) . which completes the 
proof of Lemma IA.2I □ 

Proof of Theorem 12.11 We easily deduce from (11.11) that the process (X n ) satisfies 
the fundamental autoregressive equation given, for all n > 2, by 



(A.10) 



X n = {9 + p)X n _ 1 - 9pX n ^ 2 + V n . 
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For all n > 0, let 



(All) S n = Y, x l 

k=0 
n 

(A.12) P n = J2Wk-i, 



k=i 

n 



(A.13) M n = J2 X k-i y k 



where Pq = and Mq = 0. It is not hard to see from (1A.10I) that for all n > 2, 

P n = (6 + p)S n _ 1 - QpP n _ x + M n + pX (5 - X ) 
which implies that 

(A.14) (1 + 6p)P n = (9 + p)S n ^ + M n + Q P X n X n _ x + pX (e - X ). 

Via (12. II) . (1A.14I) leads to the main decomposition 

1 J n 1 + #p + 1 + 9p 5 n _x + 1 + flp 5 n _! 

where the remainder term 

R n = 9pX n X n _i + pX (eo — X ). 

For all n > 1, denote by J-"„ the cr-algebra of the events occurring up to time n, F n = 
a(X , £ ,Vx, . . . , V n ). We infer from (1A.13f) that (M n ) is a locally square-integrable 
real martingale [3], [9] with predictable quadratic variation given by (M) = and 
for all n > 1, 

?i 

(M) n = ^E^-M^O 2 !^-!], 
fc=i 
?i 

fc=i 

Furthermore, it follows from ( 1A.10I) and Corollary 1.3.25 of |3] that n = 0(S n ) a.s. 
Then, we deduce from the strong law of large numbers for martingales given e.g. by 
Theorem 1.3.15 of [3] that 

M n 

lim = a.s. 

n->oo (M) n 

which of course ensures that 

(A. 16) lim —2- = a.s. 

It remains to show that the remainder R n = o(S n -i) a.s. We have from ( 1A.4I) with 
a = 2 that \X n \ = o{y/n) a.s. which implies that _R n = o(n) a.s. However, we 
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already saw that n = 0(S n ) a.s. Hence, 

(A.17) lim = a.s. 

<->n-l 



n— >oo 



Finally, it follows from flATTSl) together with flATTHll and f lA~T7l) that 

l lm l = «±£- a.s. 

ra-Kx) 1 + 

which achieves the proof of Theorem 12.11 □ 

A.2. Proof of Theorem [HH 

In order to establish the asymptotic normality of the least squares estimator 6 n , 
it is necessary to be more precise in Lemma [A. 21 with a = 2. 

Lemma A. 3. Assume that the initial values Xq and Eq are square-integrable and 
that (V n ) is a sequence of square-integrable, independent and identically distributed 
random variables with zero mean and variance a 2 > 0. Then, 



^ — £ a.s. 

n— s-oo n ^— ' 
k=l 



(A. 18) lim-Vx 

where the limiting value 
(A.19) « + 



(1-9 2 )(1-»P)(1-P 2 ) 
In addition, if l\ = 6*£, then 

1 " 

(A.20) lim - VXfeX fc _i = t x a.s. 

n— s-oo n ^ — ' 
k=l 

Proof. We deduce from the fundamental autoregressive equation ( 1A.10I) together 
with straightforward calculations that for all n > 2, 

S n = (6 + p) 2 S n ^ + (6p) 2 S n ^ + L n -26p(6 + p)P n ^ 
+2(6 + p)M n -26pN n + £ 1 

where S n , P n and M n are respectively given by (lA.lip . (1A. 12h and (1A. 13j) . the last 
term & = (1 - 20p - p 2 )X 2 + p 2 s 2 + 26pX e + 2p{e - X )V X and, for all n > 2, 



(A.21) L n = J2 V k 2 > 

fc=i 

n 

(A.22) N n = J2 X k-2V k - 

k=2 

Consequently, 

(A.23) (1 - (6 + p) 2 - (6p) 2 )S n = L n - 26p(6 + p)P n + 2(9 + p)M n - 26pN n - T n 
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where the remainder term 

T n = ((6 + pf + (6p) 2 )X 2 + {OpfXl^ - 26p(6 + p)X n X n _ 1 - 
It follows from (lA.lj) with a = 2 that 

(A.24) lim — = a 2 a.s. 

n— >oo n 

In addition, we already saw from equation (lA.14j) that P n = 9*S n -i + o(S f n _i) a.s. 
which clearly implies 

(A.25) P n = 6*S n + o{S n ) a.s. 

Moreover, (N n ) given by (1A.22|) is a locally square-integrable real martingale sharing 
the same almost sure properties than (M n ). More precisely, its predictable quadratic 
variation is given by (N) n = a 2 S n - 2 which means that 

(A. 26) lim — - = and lim — - = a.s. 



Furthermore, we have from (1A.4|) with a = 2 that X 2 = o(n) a.s. It ensures by use 
of n — 0(S n ) a.s. that 

T 

(A.27) lim = a.s. 

n->oo S n 

Therefore, it follows from the conjunction of flA~23|) . fTOBD . flA~26l) . and ffA~27|) that 

(A.28) (l-(6 + pf -(6p) 2 -26p(6 + p)6*)S n = L n + o(S n ) a.s. 

Finally, dividing both sides of ()A.28j) by n and letting n goes to infinity, we deduce 
from (TAT241 that 



ff^ a 2 (l + gp) 

n (l-^p)(l-^ 2 )(l-p 2 ) 



a.s. 



n^oo n (1 -^p)(l -0 2 )(1 -p 2 ) 

These two limits will often be used in all the sequel. □ 

Proof of Theorem 12.21 We are now in the position to prove the asymptotic 
normality of 9 n . We have from the main decomposition (IA. 15[) that for all n > 2, 

(A, 9 ) ^-r) = ^(^)fa + ^(^)£. 

We shall make use of the central limit theorem for martingales given e.g. by Corollary 
2.1.10 of [3], to establish the asymptotic normality of the first term in the right- 
hand side of (1A.29|) . On the other hand, we will also show that the second term 



y/nR n J S n ^\ goes to zero almost surely. First of all, it follows from flA.18j) that 



(A.30) lim = a 2 i a.s. 

n— kx) Tl 
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From now on, in order to apply the central limit theorem for martingales, it is 
necessary to prove that the Lindeberg condition is satisfied. For all n > 1, denote 
AM n = X n _iV n . One only has to show that for all e > 0, 



(A.31) 



1 n *P 



k=l 



However, we have assumed that (V^) has a finite moment of order 4, r 4 = E[V^ 4 ]. 
Hence, for all n > 1, E[| AM n | 4 | .F n _i] = ELY^V 4 ] J^x] = r 4 X 4 „ x . In addition, we 
deduce from (1A.3j) with a = 4 that 



(A.32) £*i = G( 

Therefore, for all e > 0, 



n 



a.s. 



k=l 



k=l 



1 n 1 n 

-^E[|AM fc | 2 I |A A 4 |>^l^-i] < ^E E D AM *| 4 |^i]> 

k=l 
n 

IX.- 

k=l 

Consequently, (1A.32I) ensures that 
1 n 

-^E [lAM,! 2 !,^,^!^!] = 0{n- 1 ) a.s. 



e 2 n 2 



k=l 



and the Lindeberg condition is clearly satisfied. We can conclude from the central 
limit theorem for martingales that 



1 M n ^A/-(0 )( 7Y) 
v n 



(A.33) 

in which the asymptotic variance is the deterministic limit given by ( 1A.30I) . More- 
over, as £ > 0, we have from ( 1A.33|) and Slutsky's lemma that 

(A.34) ^^-^^(O,^- 1 ). 

It only remains to prove that \/nR n = o(SXi) a.s. We have from (I A .41) with a = 4 
that \X n \ = o(n 1//4 ) a.s. which implies that \/nR n = o(n) a.s. Hence, 

(A.35) lim 



S n -i 







a.s. 



Finally, it follows from flA.29j) together with flA.34j) and (IA.35j) that 

where the asymptotic variance 

,_ a 2 _ (l-£ 2 )(l-flp)(l-p 2 ) 



£(l + 6p) 2 

which achieves the proof of Theorem 12.21 



□ 
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A.3. Proof of Theorem [2H1 

Denote by f n the explosion coefficient associated with the locally square-integrable 
real martingale (M n ), given for all n > 0, by 

(A.36) /„ = ^. 

It clearly follows from HA.18[) that f n tends to zero almost surely Consequently, by 
virtue of the quadratic strong law for martingales given by Theorem 3 of [1] or [2] , 



cr 2 a.s. 



(A.37) 

In addition, by summation of equation flA. 15j) . we have for all n > 1, 

hRk 



2 A . (M k R k 



'fc-i 



We already saw from (1A.35I) that R 2 n = o(S n -i) a-s. Moreover, by the elementary 
inequality x < — log(l — sc) where < x < 1, we obtain that / n < — log(l — f n ) 
which means that f n < logS^ — logS^-i. Thus, 

E^(^) =°( 1 ) + (E^) =0(l) + o(log5„) = o(logr2) a.s. 



Consequently, the second term of the summation is negligible compared to the first 
one. Furthermore, the third one is a cross-term and this ensures that it also plays a 
negligible role compared to the first term. Thereby, 



a 2 



a.s. 



(A.38) lim -L V f k S k -! (d k - 6* 

6 k=i 

Finally, as in the proof of Corollary 8 in [1] , we deduce from f ]A.18j) and (1A.38|) that 



2 ^ 



^— y* ( Qk - 



(7 

logn ^ V K "J £(iTe P ) 2 



(i-e 2 )(i-e P )(i-p 2 ) 

a.s. 



(i + e P f 

which completes the proof of the quadratic strong law (12. 5p . We shall now proceed 
to the proof of the law of iterated logarithm given by (12.61) . Kolmogorov's law of 
iterated logarithm was extended to the martingale framework by Stout [18], |19j . 
and a simplified version of this result may be found in Corollary 6.4.25 of [3]. In 
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order to apply the law of iterated logarithm for martingales, it is only necessary to 
verify that 

+00 „ 4 

(A.39) ^2^<+oo a.s. 



k 2 

k=l 



For all n > 0, denote 



k=l 

with To = 0. We clearly have 

^j^ lHH 2fc + l \ 

k=l k=l k=l V V 1 7 

However, we already saw from flA.321) that T n = 0(n) a.s. Consequently, 



+00 v4 / +00 \ / +00 \ 

fc=i \fc=i / \fc=i / 



a.s. 



which immediately implies (1A.39j) . Then, we obtain from the law of iterated loga- 
rithm for martingales that 

.. / (M) n \ 1/2 M n . / (M) n M n 

hm sup — ■ — - — = — hm mi 



21oglog(M) n ; (M) n n^oc V.21oglog(M) n ; (M) n 

= 1 a.s. 

Whence, as (M) n = a 2 S n -i, we deduce from flA.18j) that 

n V /2 M n . , / n \ 1/2 M n 



lim sup — — — = — lim inf 



21oglogn/ S n ^i \2\og\ogn J S n _i 

(A.40) = 

Furthermore, we obviously have from (IA.35[) that 

n \ 1/2 R n 



(A.41) lim — — — — = a.s. 

y 2 log log n J S n _i 

Finally, (12. 6p follows from the conjunction of (1A.15|) . ( 1A.40[) and (1A.41[) . completing 
the proof of Theorem 12.31 □ 
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B.l. Proof of Theorem SHI 

In order to establish the almost sure convergence of the least squares estimator 
p n , it is necessary to start with a useful technical lemma. 

Lemma B.l. Assume that the initial values X and Eq are square-integrable and 
that (V n ) is a sequence of square-integrable, independent and identically distributed 
random variables with zero mean and variance a 2 > 0. Then, 

(B.l) lim - Vtt^ = 4 a.s. 

moo n 

k=2 

where the limiting value 

rR21 _ a 2 ((e + P ) 2 -e P (i + e P )) 

1 • ] 2 (i-^)(i_^)(i_ p 2 ) • 

Proof. Proceeding as in the proof of Lemma [A. 3[ we deduce from (IA.10I) that for all 
n > 2, 

n 

(B.3) Q n = W k _ 2 = (6 + p)P n _ 1 - e P S n „ 2 + N n 

k=2 

where S n , P n and N n are respectively given by flA.llj) . flA.12j) and flA.221) . We 
already saw in Appendix A that N n = o(n) a.s. Hence, it follows from (lA.18j) and 
flAT20|) that 

lim ^ = (9 + p)i x - Qpi = £ 2 a.s. 

n— >oo n 

which achieves the proof of Lemma IB. II □ 

Proof of Theorem 13. 1L We are now in the position to prove the almost sure 
convergence of p n to p* given by (jl.3p . For all n > 1, denote 

n n 

I n = ^2e k E k -i and J n = S ^e k 2 . 

k=l fc=0 

It is not hard to see that 

(b.4) i n = p n -e n (s n ^ + Q n ) + e 2 p n ^, 

(B.5) J n = S n — 29 n P n + 6 2 S n ^i. 

Consequently, it follows from convergence (I2.2p together with flA.181) . flA.201) and 
dB~T]) that 

lim — = h -0*(£ + e 2 ) + {9*) 2 li a.s. 

= 0p0*Z(l-(6*) 2 ) a.s. 
(B.6) = p*£(l-(9*f) a.s. 
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since p* = 6p6* . By the same token, 

lim — = £ - 20% + (9*) 2 £ a.s. 

n— >oo n 

(B.7) = £(l-(9*) 2 ) a.s. 

One can observe that £ > and \9*\ < 1, which implies that i(l — (9*) 2 ) > 0. 
Therefore, we deduce from ( 13. 2p . f ]B.6j) and (1B.7|) that 



4_ - (9* ^ 2 

7 n _i £(1 - (9*) 

which completes the proof of Theorem 13.11 □ 



lim p n = lim - — = — = p* a.s. 

n->oc n.->oc — (9*) Z j 



B.2. Proof of Theorem SH. 

First of all, we already saw from fl A. 15[) that 

(b,) ^. r) = ^ + ML 

where R n {6) = 9 pX n X n _i+ pX (e —X ) . Our goal is to find a similar decomposition 
for p n — p*. On the one hand, we deduce from (1A.14I) that 

(B.9) P n = 9*S n + — + 

1 + 6>p 1 + #p 

where ^ = - (0 + p)A^. On the other hand, we obtain from (lR3l) and (lB~9l 

that 

(B.10) Q n = ((0 + p)9* - 9p))S n + 0*M n + N n + £ 



with = 9*^ - (9 + + 9p{X 2 n + X^). Then, it follows from (lR4l) 

(IB. 91) and ( IB. 101) together with tedious but straightforward calculations that 

(B.ll) I n = 9* (9p - 9*p*)S n + M « " d * N n - (On - 9*) F n + e n 

where F n = S n + Q„ - (9 n + 9*)P n , 

£i = o n x 2 n - 9 2 X n X n ^i + f Y+9p ) ^" ~~ ' 

Via the same lines, we also find from (IB. 51) . (1B.9j) and ( ]B.10p that 



(B.12) J n _! = (1 - (9*) 2 )S n - [y^j M n - (9 n - 9*)G n + £ J n 
where G n = 2P n - (9 n + 9*)S n , 
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Replacing I n and J n ~i by the expansions ( IB. Ill) and ( 1B.12f) . we obtain from the 
identity J n -i{p n - p*) = I n - p*J n -i that 



J n -l(Pn ~ P*) 



P 



1 



M n - e*N n - (e n - e*)H n + £- 



where H n = F n — p*G n . One can observe that the leading term depending on S n 
vanishes as it should, since 

(0* (Op - 9*p*)) - p* (1 - (6*) 2 )) = 0. 

Consequently, we deduce from flB.8j) that 



(B.13) 
where 



T (n n*\ - TnMn ft*N -L Rn ^ 



Op 



T 



i + e*p* 



Sn-i 



R n { P ) = (i + e P )(a-P*^)-^P^ 



In contrast to flB.8p . it was much more tricky to establish relation (IB. 13[) . We are 
now in the position to prove the joint asymptotic normality of 9 n and p n . Using the 
same approach as in [21], it follows from ( IB. 8}) and ( IB. 13j) that 

(B.14) "-— ' 1 

where 



/ 1 



-4, 



n 



l + 0p 



5*71-1 

T 



6 n -0* 
Pn-P* 

o \ 

(D + P) 



M n 



and 



B n 



n 



1 



/ Rn(0) \ 

S n -i 

Rn(p) 



\jn-l Jn-l ) V Jn-l ' 

On the one hand, we obtain from (fAlSl) . (tOOjl . flBTT]) and (IB~7l) that 
(B.15) lim A n = A a.s. 

n— >oo 

where A is the limiting matrix given by 

1 / 1 - (6*f 

*) 2 -(e + p) 



(B.16) 



A 



On the other hand, as in the proof of (1A.35|) . we clearly have 






(B.17) 



lim Bn 



a.s. 
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Furthermore, (Z n ) is a two-dimensional real martingale [3], [H] with increasing pro- 
cess given, for all n > 2, by 



a 



Pn-l S n _2 



We deduce from ( lA~T8l) and (TA~20]) that 



(B.18) lim -(Z) n = L a.s. 

n— 5>oo n 

where L is the positive-definite symmetric matrix given by 

1 6* 



(B.19) 



a 



e* 



We also immediately derive from ( 1A.32I) that (Z n ) satisfies the Lindeberg condition. 
Therefore, we can conclude from the central limit theorem for multidimensional 
martingales given e.g. by Corollary 2.1.10 of [3J that 



■ Z n ^Af(0,L). 

n 



(B.20) 

Finally, we find from the conjunction of flB.14j) . flB.15j) . (IB.17j) . and flB.20j) together 
with Slutsky's lemma that 



Pn~ P* 



C 



M (0, ALA' 



One can easily check the identity T = ALA' via flB.16j) and (IB.19j) . where T is given 
by (13. 5p , which achieves the proof of Theorem 13.21 □ 



B.3. Proof of Theorem [3H. 

The proof of the quadratic strong law for 9 n relies on the quadratic strong law for 
the martingale (M n ) given by f)A.37j) 

1 V- t ( M l\ 2 

n^oologW^ \S k -iJ 

which implies that 

1 A/M fc \ 2 a 2 
B.21 lim- Y tt^ =^r a - s - 

In order to establish a similar result for p n , we shall introduce a suitable martingale 
(L n ) which is a linear combination of (M n ) and (N n ). The sequence (L n ) is defined 
by Lq = 0, L\ = XqVi and, for all n > 2, 

n 

(B.22) L n = M n - aN n = L x + ^(X fe _! - aX fe _ 2 )T4 

fc=2 
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where 



e + P 



6p+(6*) 2 ' 

We infer from ( 1A.13I) and ( 1A.22I) together with ( IB. 221) that (L n ) is a locally square- 
integrable real martingale with predictable quadratic variation given by (L)o = 0, 
(L)i = o 2 Xl and for all n > 2, 

(L) n = a 2 {S n ^i - 2aP n - 1 + a 2 S n - 2 )- 

Moreover, we clearly deduce from ( 1A.18I) and ( 1 A. 2011 that 



(B.23) 



a.s. 



n— >oo n 

where b = 1 — 2a0* + a 2 . It also comes from a tedious calculation that 
fB24l a 2 (l-9 2 )(l-p 2 )c 

where c = (6 + p) 2 (l + dp) 2 + ($p) 2 (l — # 2 )(1 — p 2 )- Then, via the same arguments 
as in the proof of flB.21jl . we obtain from (1B.23|1 that 



(B.25) 



lim 

6 k=i 



Sk-i 



2 2l 

a z b 



a.s. 



Furthermore, it follows from (IB.13P that 



(B.26) 
where 



Jn-l(Pn ~ P*) 



1*\2 



L n + Cn 



e*L 



- + Cn 



Cn 



(n 2 \ M , Rn{p) 



We obtain from (1B.21jl and the almost sure convergence of T n to 9p + (6*) 2 that 



E 

fc=i 



'S'/c-i 



o(logn) 



Consequently, (IB.25[) and (IB.26[) lead to 



1 

lim \ 

to fc=i 



Pfc -p 



a.s. 



a.s. 



In addition, we get from (IB. 711 that 



lim ^ = 1 - (0*) 2 



which implies that 

1 n 

(B.27) lim- ^(p fe -p* 



a.s. 



a 2 b(6 



k=l 



a.s. 
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However, we clearly have from flA. 19[) that 

a\e*f (9 + p) 2 (l-9p)(l + 9p) 

£(l-(0*)2)2 (l_^2)( 1 _ p 2) 

Finally, we can deduce from ( IB. 241) and ( IB. 271) that 

n 



hm y_.[Pk-P) = n , a Xi = ° P a.s. 

n-Hx log n z — ^ \ / (1 + Bp) 6 H 



which completes the proof of the quadratic strong law (13. 8p . The law of iterated 
logarithm given by ( 13. 9 \ is much more easy to handle. In order to make use of the 
law of iterated logarithm for the martingale (L n ), it is only necessary to verify that 

E(Xk — aXk-\) A 
- 2 < +oo a.s. 

k=i 

which of course follows from ( ]A.39j) . Consequently, we obtain that 

l- ( (L}n \ ^ L n f (L} n \ ^ L n 

hm sup — ■ — - — - — — - — — = — hm mi 



21oglog(L) n y (L) n n^oo \21oglog(L) n y (L) n 

= 1 a.s. 

Therefore, we deduce from (IB. 231) that 

n \ L n „ / n \ 1 ^ 2 L 



lim sup — ■ — - — — = — lim inf 



2 log log nj (L) n n-^oo \ 2 log log nj (L) n 

1 



a.s. 



Whence, the convergence 

lim 

(L) n a 2 b 



,. Jn-l 1 " (d*Y 

hm 7— ; = — — a.s. 



implies that 



n \ 1/2 L n ,. . r ( n \ 1/2 L r 



lim sup — ■ — = — lim inf 



2 log log nj J n -\ n ^°° \ 2 log log nj J n ~\ 
(B.28) = a.s. 

One can be convinced that the remainder term ( n at the right-hand side of ( IB. 261) 
plays a negligible role compared to L n . Finally, (IB.26[) and (IB.28[) ensure that 

\ 1/2 / \ 1/2 



lim sup — — : [Pn-P) = -lim inf — — [p n - p* 

2 log log nj V / n^oo y 2 log log n 



a 



Vb~6* 



cr p a.s. 



aVt{l ~ i 6 *) 2 ) 

which ends the proof of Theorem 13.31 □ 
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C.l. Proof of Theorem 14.11 

First of all, we establish a very useful linear relation between the Durbin- Watson 
statistic D n and the least squares estimator p n , which allows us to deduce the as- 
ymptotic behavior of D n . For all n > 1, set 



In — ^^ £ k £ k-li Jn — ^^^fc 2 ' Kn ~ { £ k ~ £ k-l) j 

k=l k=0 k=l 

e 2 

Jn j ■ 

<Jn 

It is not hard to see that 

n n n 

K n = Y;^ 2 - 2 Ys + Yl ^-1 = 2 (Jn-l - h) + £ l ~ B 2 . 

k=l k=l k=l 

Consequently, it follows from (14. ip that 

(C.l) (J n _! + e 2 )D n = 2(j n _x - 7 n ) + f 2 - e 2 . 

Therefore, dividing both sides of (IC.ll) by J re _i, we obtain that 
(C.2) 3 n = 2 (l-f n )(l-p n )+i n 

where 

F 2 - F 2 
t L n L 

•Jn 

We already saw from (IB.Tfl that 

(C.3) lim ^ = £(1- (6*) 2 ) a.s. 

n— >oo 7| 

with £(1 — (#*) 2 ) > 0, which implies that both f n and £ n converge to zero almost 
surely Hence, we deduce from (10. 2|) that 



lim D n = D* a.s. 

n— >oo 



where D* = 2(1 — p*), which completes the proof of Theorem 14. 1 1 □ 

C.2. Proof of Theorem [421 

We shall now prove the asymptotic normality of D n using f !3.Tj) . On the one hand, 
we clearly have from (1C.2p that 

(C.4) V^(D n - D*) = -2(1 - f n )V^(p n - P *) + 2(p* - l)vWn + V^n- 

On the other hand, we deduce from HA.4I) with a = 4 that 



sup e fc 2 = o{\/n) a.s. 

Kfe<n 
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which, via (I0.3|) . implies that 

(C.5) lim y/nf n = and lim y/n£ n = a.s. 

n— ¥oo n— >oo 

Then, it follows from (13. 7ft . (IC.4I) and ( 1C.5I) together with Slutsky's lemma that 

y/n {p n — D*^j -£+Af(0,a 2 D ) 



where a 2 D = Aa 2 , which achieves the proof of Theorem 14.21 □ 



C.3. Proof of Theorem [Q 

We immediately deduce from relation (10. 2|) that 

(C.6) D n — D* = -2(1 - /„) (p n - p*) + C„ 



where ( n = 2(p* — l)f n + C, n . Consequently, by summation of flC.6p . we obtain that 
for all n > 1, 

n 2 n 

(c.7) J2( 3 *- D *) =E( 4 ( 1 -^) 2 (^-^) 2 +^ 2 - 4 ( 1 -^(^-^))- 

k=l k=l 

Since f n goes to zero almost surely, we have 

n / n \ / n \ 

Y,C = 0{l) + [J2fk )=0(l) + o hT/ fc Uo(logn) 
fe=l \fc=l / \fe=l / 

Hence, we infer from (I3.8P and ACT)) that 



1 n 2 

]i m ^Y(D k -D*) =4a 2 = a 2 D 

to k=l 



a.s. 



Furthermore, the law of iterated logarithm (14.60 immediately follows from (13.91) and 
(1C.5j) , which completes the proof of Theorem 14.31 □ 



C.4. Proof of Theorem 14.51 

We shall now establish the asymptotic behavior associated to our Durbin- Watson 
statistical test. It follows from the identity 9 n = 8 n + p n — Po and (14. 13f) that 
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Pn Pn Pn 



%i + Po) 



1 + PoO n 
Pn + PoO nPn Po^n (0 n + Po) 

1 + Pod n 
Pn + Po8n(Pn ~ On ~ Po) 
1 + Pod n 

Pn — P$rfin 
1 - 



Hence, if 7 n = p n — 6p 8 n and 5 n = 9 n + p n — 9 — p , we find that 

Pn ~ Po0n(6n + Pn ~ Po) In " 



(C.8) 
Denote 



Pn ~ Pr> 



An 



n$n 



Po 



1 + Po^ 



and Po 



1 + Po#n 
Qo(0 + Po) 

1 + 0A! 



Since Pq = 9p 9^ and ^ + Po = + Po, we obtain that % = p n ~ Po ~ #Po(#n - #o) 
and 5 n = 9 n + p„ — 9q — pjj. Consequently, we deduce from (10. 8|) that 



(C.9) 



Pn - P^ 



a(0n - &o) + &(Pn - Po) PoSn(0 n -9* 



1 + Po#n 



1 + PO#n 



where a = —po(9 + 9q) and 6=1 — po#o- O n the other hand, it follows from (1C.2j) 
that 

D n -D n = 2(l-/ n )(l-p n )+e„-2(l-p n ), 

= -2 (p n - p n ) - 2/ n (l - p n ) + £ n , 

(CIO) = -2(p n -p n )+A n 

where A n = £ n — 2/ n (l — p n ). Therefore, (IC9[) together with (IC.lOj) imply that 



Vn{D n - D n ) = — + — ^ h V^A r 



(C.ll) 



where t> and w are the vectors of IR 2 given by v' = (1,0), w' = (a,b) and 

\Pn ~ Po) 

We already saw by (1C.5I) that 

(C.12) lim ^nA n = a.s. 
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Moreover, as \5 n \ < \9 n — 9q\ + \p n — Pq|, the almost sure rates of convergence given 
by (12. 8p and (13. lip ensure that under the null hypothesis Ho, 

' log log n 



6 n v'W n 



o 



leading to 
(C.13) 



lim 5 n v'W n 

71— >00 



n 







a.s. 



a.s. 



Consequently, it follows from the joint asymptotic normality (13. 6p together with 
Slutsky's lemma, (IC.lip . flC 12|) and (1C 1 3|) that under the null hypothesis Ho, 



(C.14) 
with 



\/n[D n - D n 



T~ 



-w'Tw 



(1 + PoO) 2 

where the covariance matrix T is given by (13.51) . We recall from Remark 13. II that T 
is invertible as soon as 9 ^ —p, which implies that r 2 > 0. In addition, we obtain 
from (14141) and (14151) that 

(C.15) lim r n 2 = r 2 a.s. 



Finally, we deduce from ( lC.14p . ( 1C.15P and once again from Slutsky's lemma that 
under the null hypothesis Hq, 



y/n 



(5 n -D n ) -AjV(0,l) 



which obviously implies (14. 16ft . It remains to show that under the alternative hy- 
pothesis Hi, our test statistic goes almost surely to infinity. We already saw from 
( 133]) that 

9p{9 + p) 



(C.16) 



lim p n 



a.s. 



Moreover, as 9 n converges almost surely to 9 + p — po, we obtain that 

Po(9 + p)(9 + p-po) 



(C.17) 



lim p r 



l + Po(9 + p-p ) 
Hence, it follows from (1C.16P and (1C.17I) that 

(9 + p)(9 - p )(p - po) 



a.s. 



(C.18) 



lim {p n - p n ) 



a.s. 



(l + 9p)(l + po(9 + p-p )) 

Under the alternative hypothesis, this limit is equal to zero if and only if 9 = po or 
9 = —p. However, these particular cases are already excluded from the study of "Hi- 
Consequently, under Hi, we deduce from (1C.18I) that 

lim n(p n — p n ) 2 = +oo a.s. 
which, via (IC.lOp . clearly leads to (I4.17p . completing the proof of Theorem 14.51 □ 
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